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The program provlAad reading ^struction tg 1484 Tltla I eligible 
pupils for 3«l/2 hotirs each day for 28 d^g, with sOTa variations* Ss^Jl 
4Toup and individualized instruction was providad by I78 teaeherg aiaiited 
by k6 paraprofesslonala, under the supervision of 21 teachers*ia*aharge, 
Twj asalstMt eoordinatora ^nd the project eoordinator ii^srviaed the 
entire pro-am. All pupils were given entry and smatery tests wSJth 
stmdardiiEed criterlon-refarenoed teats fros the CWFT readtog system* 
A trip progrssi provided recreational op^rtunlties ^d socialising 
e^^arlenceip 

The major evaluation objective of this progrM was achieved in that 
70 p^ruent of the participants mastered at least one infitructlonal objective 
which prior to the pro-am they did not mater. The data further indicated 
that pupils did benefit iubstantially and that the crlterion*r€ferenoed ^ 
test aK»roaah to the teaching of reading waa an effective instructional 
procedure as evidenced by the post-^inatruction mastery of 20 instructional 
objectives by 39 to 100 percent of the students att^ting them, 

Prograia iinpleffientatlon was as proposed with the exception of ha^d.ng 
90 percent (ik&k) of the ^ticipated I6UO pwticipants. The pupUa 
expresaed and observed attitudes and behaviors further attested to the 
effectivenaas of the program. In aonsideration of the factors mentioned 
it ii recomended that this progresi be recycled. 
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Chapter I: TIffi PROGRAM 

A, DESCRIPTION OP TIffi PROGMM 

ThlB prograjji was designed to serve children attending the apealal 
day schools, psychiatric ho^pitaas and day and residential treatment 
centers for the socially- aaladjusted and raotionally disturbed in 
Kindergarten to ISth grades who were in need of aji eirtanded school year 
program in reading* The stated purpose of the program was "to improve 
achievement in reading and to provide meaningful iOcialigation activities 
for these children during the sumer jnonths." 

The proposal called for provisions for instruction for approximately 
1^6U0 Title I eligible pupils for 3-1/2 hours each day for 28 days in 
school, agency^ or institutional settings* The progras was to take place 
in 12 special day schools for socially maladjusted or emotionally 
disturbed children^ nine psychiatric hospitals, l6 day and/or residential 
breatment centers for emotionally handicapped children^ and 30 day and/or 
residential trecitment centers for addicted children. These 6? sites were 
located in all of the five boroughs of New tork City and four sites in 
upstate New york. They were clustered- into ai school organiEationi for 
purpose of supervision of the instructlonaa program. There was to be a 
maximum class size of 10 pupils to each teacher. 

The objective of the program was "To help pupils achieve mastery of 
Instructional objectives in reading which they fall prior to instruction 
as measured by the CROFT (Beading) criterion referenced tests*" 
Consequently, the instructional program was to Include testing of all 
participants with standardised criterion referenced entry and mastery 
tests* The fomer was to be administered to identify one or more specific 
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reading skill needi for each student^ while the latter was t© datera^e 
if the student had acquired any of these sk^a during the com'se of the 
prograa. Small group and individualized inBtructlM directed toward 
remediation of the identified specific reading needs of each pupil was 
to be conducted by 177 teacheri asiisted by k£ paraprofeaaioMli wder 
the supervision of 21 teachers-iji-charge. A trip prop'sa of comOT 
experiential activities^ coordinated by a trip teaeher, was to be utilised 
to itimulate language skilla developMnti provide recreational opportuni- 
ties, ^d opportimitiea for wholesoM socializing experiences. 

The basic daily progrim structure was to consist of two aepaents: 
one period of at least 1-l/S hours in reading in sa^J. p^oups or 
individualized; and one additional sepnent in activities desipied to 
apply and reinforce reading skills. Recreational activities were to be 
spread throughout the school day. 

Two assistant coordinatori assisted by two secretaries were to be 
responsible for the supervision of the prograsi dividing their responsibili- 
ties geographically. They were to coordinate the instructional -gTO^BMf 
serve as liaison with related prograais, and work closfily with the 
evaluator. 

There were to be 21 on-site secretaries provided to assist the 
teachers ih-charge in miintaining student recordi, preparing reports^ 
inventories j requisitions , and payrolls. 

The progTWn was to comotence on July 1^ 1975 Md continue through 
August 19 j 197?. The nui^er of days of instruction were espected to' 
vary from site to site (23 to 28 days) depending on the needs of the 
children and the prograjn of the agency in which the program was locate. 
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B* D^mffiOTATION OF Tm PROGMM 
1, The Pupllg 

population of the program consisted of l^USli Title I eligible 
pupils. During the cowie of the program a total of 1,5^ pupils were served. 
However, there were 10k pupils (7 percent) who did not eo^lete the program. 
This was due in part to the trajisient nature of the paj'tieipasti in the 
hospitals and residential treatment settings^ as well as to the enotional 
unavailability of som of the pupils. Overallp 93 percent of the puplis 
eompleted the program* 

In the 12 day schools $ all students attending during the regular school 
year were informed of the suanner program by their teachers, guidajice 
counselors, and principals both by written and verbaQ. .coMunications prior 
to the end of the term^ All students volunteered* Applicants were reviewed 
by the staff and had to be two years below grade level in reading and eligible 
for Title I fundg to be approved for participation in the program* Several 
schools accepted pupils (approximately 10 percent) who would be entering 
the school as regular pupils in the FaU tern and referrals by coiMiunity 
schools. The number of students in the progfM varied from school to school^ 
with many having sere volunteers than allotted places, and a few having low 
registration* It was noted that these latter sitei had leas advajice 
publication of the program. AliOj at sites where there was instiffic lent 
registration, teacher and/or paraprofeisionals wer# reassi^ed to sites 
with iRrge enrollments. 

The cluster schools attempted to include all eligible students in the 
program. At residential centers aH eligible children participated, if 
space permitted J both on a voluntary and mandatory bajis dependjjig on the 
policy of the agency . Most of the day treatment centers had continued • 
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their re^^ar program into the siOTOitr and had a ready population who were 
eager to partiaipate. ^nerally there were more students voltmtiering 
than could be accoraaodated. 

Without exception^ the pupHi exhihitad very positive attttudea toward 
the progTM* Their behavior was goal directed and in aJJ. wayi a]roropriate to 
the setting* They eeeffied to an Joy good relationships with the at^f and each 
other, 

2. The Staff 

There were from one to ei^t teacheri at each sitej depending on the 
niuiier needed to maintain a 1 to 10 ratio between teacher , and students for a 
total of 178 teachers. Alnoat half (30) of the 67 sites had from one to 
three paraprofeisionali^ totamng U6, 

V^erever possible the staff consisted of teachers md paraprofessioneaa 
who taught at that site during the repalar school yeaj** instances where 
there were insufficient teachers from that site to staff the siOTiar program 
teachers from other schpoli were assi^ed. 

It was interesting to note that while this prO^am was prlmaj*ily concerned 
with reading^ the teachers ware not required to have had prior e^^erience in 
ihe teaching of reading. Many of the teachers were actually working out of 
license I although they all had had experience with special education . 

The trip teacher coordinated the trip program^ which differed from site 
to site* This aspect of the progrM served both as a recreational activity 
and a conmion experience from which to develop language a^ts skills. 

The 21 teachers'* in-charge were aU principals, SOTie were at their 
regular schools; others were supervising clusters. It was their 
responsibility to supervrise the operation of all Mpects of the progrMi. 
They were supposed to be thoroughly versed in the instructiraial co^onent ' 
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of the prDgram^ so that they could provide assistsjice to the teachers when 

' "^"neededr"' -. ... , . = .......... ............... .... ....... . ............. 

There vrere two assistant coordinators who visited the sites throughout 
the duration of the prograin* They provided assistajice aiid guidance 
wherever required to the teschers-in-chargej the teachers, and to the 
evaluator* 

Due to the fact that this was the first tiM that criterion-referenced 
testing (CRT) was being used in these schools , a staff person who is an 
expert in this area was called upon to serve the entire program as the 
Beading Coordinator. He conducted three orientation ineetings at various 
times, one preceding and two during the early weeks of the program to 
familiarize the staff with the testing and instructional procedures, 
as well as being always available for advice throughout the program* 
He also prepared a guide to the selection of iMtructional mterials 
suitable for remediation of each instructional objeetive* These were made 
available to the teaching staff. 

The program coordinator vms the overseer for the entire program* 
He made spot visits to determine the effectiveness of the prograin, ajid 

imintained liaison with States Federal, and New York City Board of 

Education offices and bureaus Involved with the program. 

Overril, the staff was composed of people who had all worked in special 

education settings prior to this program. They were faMllar with 

the nature of the students in the progrm, and with ways of assisting 

the students In order to promte learning. 

3. Functioning of the Prograjfi 

All students were tested by teachers during the first or second week 

of the progre^ (July 1 to July lO), Delays were caused by the teachers* 



10 



6 



laak of famiJ.iarity with the procedures inTOlved in GOT* As soon ai this 
^ rmomi^zei mmTsm&y orientations were con^iibtea by the Reading ^ 
Coordinator. Teaehera-in-eharge and readii^ teachers at the gchools 
also assisted those staff mei^ers who were unsm'e about how to proceed* 
Thus J the problem was rectified coniiderably. 

Once teachers had identified the specific reading objectives for each 
student the tastructional process began, Ife^terials Md equipment available 
at the schools were utilized to develop Ijidividuali^ed or smaH group 
instruction based on remediation of Identified disabilities , However, 
several sites had barely adequate instructional material.*i . 

The basic design of the instructional program was maintained for the 
most part 5 with one and a half hours used for readtag in s^ai groups 
or individually^ ^d a segment for activities to reinforce these skills t 
The recreational component ranged from playing beOl to the schoolyard 
to a formal trip progre^, niere was some variability evidenced to the 
regularity of the trips schediUed* At some schools it was a weekly 
ongoing event to places such as the Statue of Liberty^ the Aquarii^j 
the Bromc Zoo, etc. Several schools had weekly swlmdngj while still 
another had daily after-school activities (i*e., bicycle trips) conducted 
hy the staff on a voluntai^ basis. 

All students were given masteiy tests at some point during the 
program. The large majority of teachers atoinisterad these tests durtog 
the last week of contact with the students, while a sm^ proportion of 
teachers who were more familiar with CRT had students take the test when 
mastery was indicated informally on an todividual basis* 

Many teachers did not underst^d the reeord-keeptog system adequately. 
However, this did not necessarily interfere with the tostruction^ progrOT,, 



although the achievtsent data night htpve been af fee ted* 

in summry^ the program vas o^rationai f rim Jydy 1 to Ai^ust 15 
at 67 sites. There were l^WS pupila participating, ftll of whoa fi^fll led 
Title I criteria* The staff oonsisttd of 2k admtaiatratori and iupervisore 
(coordinatori and teachers-in-charge)| 178 teaoherSj k6 claairoom para* 
profeesionale, em.d 2k secretaries* The Ijiitruational pro-am utUiied 
CRT and individualized emd/or email group instsmction accordMiee with' 
the desi^ of the program, AlMit all of the teacheri were initially 
unfamiliar with the procedures Md record keeping system tavplved in the 
program* The instructional materials varied from site to site^ with 
some utilizing Reading Laboratories, and others having barely adequate 
supplies* 
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; . Chapter iir mMmTim mocmsms 

1 . To dataraine if , as a rasult of partlelpatlon iji the pro^ami * - 
70 percent of the p^lis master at le^ t oaa instruot lanal 
ohjectivt vhiah prior to the program they did not Mater* 

Using the 1975 Tltla I aityirida taat rasults as a lavaleri ^1 

partiaipanta were admlnlstarad, as a pretest , ialeatadariterlon-refaranaad 

tests from the CROIT (Raading) systm to uoartain individual iMtruotional 

objactivas for aaah pupil. For instruational ohjaatlva dia^osed as 

requiring remadiatlon (sB detei:^ was 

administered on an individual basis ^*ter an appr^rlate Jjatarval of 

ijiitruetlon* For each instruotional ohJectiye| results of paising Md 

failing on both the pre- and poattast wara supposed to ha raeordad ou the 

Glass Evatluation Reeord. Howav^r the notation of f ailad posttasts was 

omitted by the program, 

Tabla 1 ahowi tha analysis of the data in tabular form aseert^ni^ 

the percentage of part iaipmta defflonatrating mastery or non-maatary of . 

each inatruetloniJ. objactive (aaeoi^lng to QlMsifieatlon syst at 

initial testing and final tasting, 

2, To deterBdjia, as a result of participation in the pro^ami the 
extent to which pupils demonstrate mastary of instructional ^ . 
objectives. 

The s^se methods ajid procedures wara used to evaluate this objective 
as were used for the first objective ^ as stated above, Ae data were 
analyzed and presented in tabular aiid narrative form to ascertain each 
of the following distributions : 

The distribution of pi^Us fid^ling to dCTOnstrate mastery prior to 
instruction not receiving sufficient instruction to receive the posttest 
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ii shown in Table 2. ' 

TOie distribution of pupili demonatrsting masteiy of objeetives prior 
to instruction is ahoTO in Table 3, 

The distribution of pi^il m^%st©ry as a result of l^atruation by 
instruction^ objeatlves is shoim iii Table 4* 

The distribution of the nudber of obJaQtives masterad as a result 
of instruction is shown in Table 5. 

Kie distribution of pereentage of pupils aohieving various levals 

of inastery of instructional objectives is shown In Table 6, 

3* To detamine the ertent to which the progrMi, as actually 
carried out^ coincided with the pro-am as described in 
the Project Proposal, 

Forty percent of the participating 67 sites ware visited by the 

evaluator* The perionnel at each site were Intarviawadj aa were a a sapling of 

the students. Instruction^ materials ^ plaaS| tests ani records were 

examined* AH classei (totEa of 86) at each site were observed* 

B. OBSERVATION OF ^ PRMRAM 

The evaluation desipi called for I6 school visitation days* Those sites 
were to be observed which had the largest nuaber of teachers md students and 
represented the three school classifications in the pro^m* Consequently 27 
sites were observed 5 eight d^ schools^ ei^t residmtial centers, and 10 
day treatment centers. They were located in each of the five borou^s of 
New York. 

Overall, 8U6 students, 86 teacherS| and 2^ paraprofessionals participated 
at the sites visited by the evaluator. TOius, the observed student population 
(8U6) was 57 percent of the target p^ulat ion of l,USi* students, 86 taachers 
were kB percent of the 177 participating teachers, and 2^ paraprofessionals 
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were laore than half (52 peMent) of the 1*6 paraprofiisioaals. Goaiequ^tly 
it wai assuMd that a reprtientative seleettd sa^lt Of the intira pyo^aa 
was observedv 

LnOTATIONS OF THE DATA 
This was the initial es^oaure of aliaDst a3i of the sttff in the 
program to a COT approach to reading inatruat ion. Despite efforts at 
orientation^ there is evidence of inappropriate initial gelection of the 
tests, Alsoj the Crfot (Rtadteg) system extends to the sixth grade level 
whereas the pro-am was desipied to servloe students ttoou^ the tweJJ^h 
grade. Consequently it was asaimed that soiae of the pupils were beyond 
the scope of the tests used. However^ the aest relewt limitatioa to 
an Interpretation of the data was the pro^tt's authorisation of the omias ion 
of faUed posttests from, the Class Evaluation Record, Ttm rwiif iaations of 
these limitations are discussed with the findingi. 
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The following preaentation of findingi is in accordarice with the 
evaluation deiign speoifications regarding the ajialyaii of data relatljig 
to each of the objectivei. 

The first evaluation objeetive wbmi 

To deteMine If, as a result of partioipation in the progrMa, 
70 percent of the pupils master at least one inatruetlonal 
objeetive which prior to the program they did not master, 

Thia ev^uation objective waa satiafied as 70 peraent ©f the population 

who coi^leted the program (N = 1^8^) maatered at least ont objective after 

inatruetion* 

Table 1 provides a cCTiplete deacription of the CRT syatem utilization 
ascertains the nunbera and percentages of pM'tlcipants who took each 
of the aubtesta, and the niters and percenta of thoae demoastrating maatary 
or non-maatery of each instructional objective at Initial and final tea ting. 
Examination of the tests adMnistered indieatea that a total of 73^^ teats 
were given at the initial teatingj indicattag that each/of the IjSS pi^ils 
who began the prograra had between four and five initial teats* Theae ljiclud»l 
21 different subteatSj with aore given to less thaii 1 percent of the pupila 
and others given to as mmiy as 62 perceni, ^ree Ijistructional objective 
testi on Organising Informtlon (SED claasifioatlons) were t^en by loore 
than half of the total population i (Clasalfying (2-U*2)j Identifying 
Details ajid Main Idea Sisrty-two percent of the pupils were 

given the Classifying Test with 72 percent of those taking it maatering it 
on the initial testing; 58 percent of the 62 percent of pupUa taking the 
test on Main Idea mastered it on the initial testljigi and kk percent of the 
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I^LE 1 

DlSTRraUriON OF PUPII£ raS^D ON MCH BISTRircTIOHAl OBjlCTIVE, 

Tmm msmm or Nra?-msmERY on dikial and fdial tests ^ 

. HUmiRS AND PERCENIAGES 

= (N ^ 1588) 

aitial Testis Flml Tasting 



tnatruetional Pupils Tested for Pupili D^aonatrating ftipila Dwonstratlng 
Objectivea Each Objective Maste]^ Non-Mastaj^ Msate^ Non-Maatej^ 
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Total 73W* 



®These nmii>eri include lOU dropouts who are ispoisible to identify in 
the data due to the record keeping syitem utilized by the prograffi, _ _ 



Less than 1 percent. 



53 percent teited on Identifying Details did likawlie* ObviouEly attantien 
neads t© ba given to devel^ing s means to fae^itate the selection of 
appropri^a siAteitg. ' 

Tha inappropriatenees of test ialaction li underscored by the fact 
that aeross aH aubtests given initially 13 subtests of the 21 subteits 
(62 percent) were mastered by larger pereentagei of s tud ents than f^JLed, 
However J, on the final testing given to those demnstratljig n©n<-fflEatery 
on the Initial tea ting ^ larger percent ^es of pupJJ^s laastered than faHad 
l8 out of 20 (90 peroent) of the tests* Theae data indicated that this 
approach to reading initruction was effective* Poseibly aore judleioua 
selection of subtests would have yielded even inore favorable results. 

The second evaluation objective wasr 

To determine^ as a result of participation in the program, the 
extent to which pupils demonatrate mastery of instructional 
objectives* 

Table 2 shows the distribution of pupils failing to exhibit mastery 
on the pretest prior to instruction, who had not demonstrated aaatery by 
the end of the program on some or all of the skills attested* Without 
additional information it is i^ossible to determine whether or not these 
students were given final tests and failed them, or received toaufficient 
instruction to warrftnt a posttest, or did not oo^lete the program, aa was 
the case with lOU students* The method of recording on the CER calls for 
notation only when the p^ll masters the test, not for failure of ratest, 
or absent from posttest, or who dropped out of the program. This procedure 
requires change for these data to be obtained* 

. ^The relative percents cited in the text are based on the ratio of 
number of pupils mstering initial subtest 
niitoer of pupils taking the subtest 



TmM 2 

DISraiBOTlQN OF PUPIL HOI-MASTERY ON PH^IST AMD 
NO POSTTMT TOmm'W 
(M ^1588)^ 

Nuinber of tostruetiQnal 

Qbjeetlves Fallad Number of PupAls Percgntage of Pirplla 

9-10 7 

7-8 ......... ,.......k 

3-6 ' 52 

3-1+ 122 

1-2 399 

Nona 100^ 

^his nustoar inalUd&a 1(A drapouts who are jj^jossible to identify ia 
the data due to the record katpJjig a^tem utliiEed by the pro-am. 

^esi than 1 percent* 

The data indicate that 37 percent of the total population had not 
nastered ikms req.uiring reMdiatlon (l perceiit non-MLitered 7-10 object ives^ 
3 percent non-maatered 5-6 objectives^ 8 percent non-matcred 3-if objectives, 
and 25 percent non-mastered 1-2 objectives). The Ingest ^ov^ (25 percent) 
exhibited non-maitcry of 1-2 objectives which is as amy as should be 
attested at one time * Som of these atudents had aiastered other objectives 
irfter instruction. Perhaps students were es^ected to do tore than tiJie 
permitted by teacheri who were thefflselvei unfaaHiar with the C HP s^romh. 
in generia, and reading instruction, in partieiilw. It should be noted that 
these data Include the XQk students who did not co^lete the progrM and 
who are unidentifiable therein. 

The distribution of p^ils deMnstratlng oMtery of objectives prior 



b 
b 

3 
8 

25 
63 



to ^atruetlon la shown on Table 3. Almost h^f (1^ pereent) of the 
students mastered 0-25 percent of the ohjeGtives when first tested^ with 
28 percent denyDnstrating mastery on 76 to 100 pereent of the tests adminis- 
tered to th^. These data retoforce the need for developing a criterion or 
guide for B.^TOpri^'te selection of initial te^ts for the individual pupil. 

/ TABLE 3 

DISTRIBUTIOT OF FOTIL M^TERY OF nfSTRUCTlONAL 
■ [ OBJECTIVE PMOR TO DISTRUCTldN 

(N ^ 1588)a 

PerQentage of Maatary of 

Instructional Objeetivea Nunber of ^pili Peroeatage of Pupils 

76-100^ hk5 28 

' 51-751^ • 180 / 11 

S6- 50^ 225 15 

0* 251^ 738 k6 

®Thii nui^er includee IQk dropouti who are impossible to identify in 
the data due to the record keeping gyatem utilised by the program* 

Table U provides a detailed overview of pupil mastery as a result of 
instruction by each instructional, objeetive* Twenty objectives were mastered 
by pupili ranging from 35 to IM percent. The median percent of mastery 
was 66 p:ircent. Forty-three percent of the objeetivea (9 subtests) were 
mastered by more than 70 percent of the pupils who att^^ted them* However^ 
57 percent (12 subtesti ) were maitered by fewer than 69 percent of the pupils 
attej^ting them on the final testing. This latter cte^tefflent is an assiu^tion 
since no notations are called for if non-mastery is dpmonatrated* 

The effects of the instructional program are presented in Table 5 
which shows the distribution of the number of instructional objectives 
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TABLE If- 

DISTRIBUTION OF PUPIL MASTERY BY DraTRUCTlOHAL OBJECTIVE AB A . 

RESULT OF I^TRUCTION 
(N = lUSl*) 

Instruct jonal Objective Ratlo^ Percentage of Mastery 



2-1-1 


72/100 


72 


2-1-2 




71 


2-1-U 


8it/139 


60 


2-1-5 


132/206 




2-1-6 


165/286 


58 


2-1-8 


0/1 


0 


2-1-9 


25/31+ 


Ik 


2-2-1 


11/13 




2-£ 2 




82 


2-2-3 


26/33 


79 


2-2-U 


97/115 




2-2-5 


Ui/50 


82 


2-U-l 


19/U6 


kl 


2-U-2 


l>9/279 


53 


2-4-3 


90/150 


60 


2-1+-U 


326/1+78 


68 


2-U-6 


271/1+18 


65 


2-U-8 


110/118 


59 


2-1+-9 


67/189' 


35 


2-'U-l3 


i+7/71 


66 


2-5-6 


: 3/3 : ; : 


100 



nusflser of pupils achlevto^ aagtery. 
number of pupile attempt tog metery 



mastered as a result of instruction. Seventy percent of the pupilg mastered 
at least one instruct ianal objective post-instruction while 30 percent did 
not master any. The largest proportion {kB percent) of the pupila aastored 
from one to two objectivea, with 17 percent saaterljjg three to four 
ohjectives. Only 5 percent mstered more th^ five objectives, 5aiesa 
findings are most logical considering the short duration of the program 
and the staffs* initial lack of familiarity with the CKC approach to the 
teachii^ of readijig, 

TABLE 5 

DISTRrBUTlON OF ITffi NUMER OF mSTRUCTIONMi OBjECTIVES MASroRED 

AFraR ajSTRUCTION FOR TOTMi POPULATION : . 

(N\. 1U84) 

Number of Instructional Total PopulatiOT 

Objectives Mastered N %^ 

None U56 30 

1- 2 709 kS 

3- ^ 257 17 

5. 6 57 h 

7- 8 3 b 

9-10 2 b 



totals 100 percent with two groups of less than 1 percent. / 
^Less than 1 percent 

Table 6 presents the distribution of pereentagei of pupils achieving 
various levels of mastery of instructional objectives * TOie laj'gest propor- 
tion (U^f percent) of pupils achieved at the 90^-100 percent level, meanly 
that they mastered almogt all of the objectivei attested* The second 
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largast grouping at the 0-9 percent lave! (28 percent) metered less than 
10 percent of the objectives they attested. Here | too, the iJ^ortance 
of initiai iubtest selection is fflanifasted by the distribution of 72 percant 
(kk percent mni 28 percant) of the pupils at aither extr^^. 

, TABLE 6 

DlSTRmOTION OF PERCEOTA^ OF 3PUPnS ACHmVDJG VARiaJS 
TfFW-TJS OF WSTERY OF DCSTRICTIONAL OBjWTVfW 



Parcantaga of Itesteiy of 

Instructional Objeatives Hmfcer of Pup U.a Percentage of Pupils 

90-ioo?| 656 ^ 

80- 1^ 1 

60^ 69% ' _ llU 8 

50- 59* 122 8 

ko^ k9% \ 13 1 

30- 39* 70 5 

20-29* k6 3 

10^ 19* 9 1 

0- 9* **S1 28 



In iu^iaryj these data rave iJL that the prop'^ was auacessful ini that 
it met its primary objective ^ that 70 percent of the partiaipajits 
at least one ijiatruational objective ^tar inatruction which they had aot 
Eiaatered previously* Further avidenee of the merit of this approsoh was 
the mastery of 20 instructional objectivea by 35 to 100 percent of the 
s tudent a at t elating them, .1 

A need for more specific initlai teat selection eritarla is aBdieated 



by the fact that over hiaf the student i in the pro-am were given three 

iubtasts as ahowii on Table li Classifying (2-U-2)j Idanti^iDg DetallB 

(2*U*^)i and Main Idea Given the wide range of p:adai iervad 

by the pr©^am it seeM uiaikely that such a large prt^orticn of partielpants 

would be deficient in the awm skills* In faet, the Class EvsluatlQn 

Records show that entire classes were often given the saBie tests i which 

is not the intent or iMthodology of the COT individualized systea of reading 

instruction* 

The third evaluation objective was: 

To determine the ertent to which the pro^Mi aa actually 
carried out coincided with the program as describe in the 
Project Proposal* 

The program was ii^lemented as called f or Iji the proposal with 
respect to dates of operation, sites, staffs objectives, activities and 
materialai and services the needs of the population for which it wfta 
desired* The only departure from the proposal was in the size of the 
target population. The propoisl calied for approximately X6kQ pupHa ar^ 
the actual program had IkBk participants, a difference of 9 percent. During 
the six weeks in which the program was in operation there were 1,588 
participants. However, 10k students dropped out before th^ program 
terminated* Consequent^ l^USU participants cOTpleted the ^roff^Bmp or 
93 percent of the actual population* 

Several of the undereru*olled sites were visited by the evaluator and as 
^f ar as couJ^d be deten^ned there was inauffioient advmce publication of 
the pro-am* This was partici;iarly nqticeable at altee where the staff was 
notified very late about their particlpati(m in the program^ or where the 
staff was not from the regtG.ar teaching faculty at that school j thus ^ 



todicatlng tha need for ineraased aj^ioulation batwaen^ t^^ staff 
and the ragular staff , at, least at the ii^ervisory level prior to the 
beginning of the prograa* ^ ^ 

TOie liaiion factor laso eantributed a great deml to the wide r^^e 
of instruction^ imteri^e available to the program. Where the siai:ier 
staff was from the sahool, there were gener^y p^eater aecess to bH of 
the schools * resources * Nevertheless , with the exception of one site 
visited^ all had at win^m. adequate , wid most had extensive materials 
and equipa^nt. Three of these sites were using the school's Reading 
Laboratories equipped with sophisticated hardwaj-a and sort^are^ 

At all of the sites visited a ssaople of at least 10 percent of the 
students were interviewed with respect to how they felt about the program. 
In almDst an instances the resj^nses were enthusiastic, Kie coments 
enco^assed the teachers, the activities^ and the reading program. These 
positive feel iJigs and attitudes were obvious as the students, in all but 
five of the 86 clMses observed were actively engaged in what they were 
do^g. Also s examination of their work folders Indicated their seriousness 
of purpose . _ . 

In reviewing the functioning of the pro-am three staffing issues 
deserva consideration. First, it was evident from on-site observations 
and the data reported, that the presence of a teacher-in-charge daily is 
essential for optimal functioning of the pro^MQ, except in severe highly 
specialized treatment centers, vmere this would be unfeasible, rae teacher 
should be given responsibility for coordinating the program md maintaijiing 
contact with the teacher-in^eharge. This wm the case In more than one-half 
(8 out of lU sites) of the cluster schools visited. 



Second^ at sites where the suHmer prograsa stsff is not regtalar staff 
at that school comunlcati©n hetween the siimer program staff and the 
regular iohool staff and supervisors needs i^rovement* A liaison parson 
for each site where there are out-of-achool staff , to serve in this ^^^^ ; ■ 

capacity before the sumer would ei^ance the progr^* " - / 

Last J but of parwsount Jjiportajice, the teaching staff should have 
had experience with the teaching of reading to the greatest esrtent possible 
and be thoroughly f amllar with the methodolo^ associated with a COT V =: 

system* V / ; 

The 197^ Bijumer program ev^uation n^e sev recommendatians. They 

will be cited and followed by a stateinent regarding their iz^lefflantations 

1* Jfake sure that each school can agree on a eonnion test to be 
used or a comtnon set^ or no laore than two or three tests. 

2. Make sure that each school has an adequate nufflfeer of the 

required tests on hand to aaet the evaluation and testing ^ _ 

needs. ^ '" 

. 3 * Rec reat tonal and coimsun Ity vis it at ion should be cont inued , 

These recomaendations were i^lemented into the 1975 susmer program, . ; _ 

Criterion-referenced tests were selected from the CROFT reading system , ^ ^ 

These were in the form of rexographed stenclles, from which the required 

ntndDer of copies were duplicated as needed. The recreational and visitation 

phase was continued under the supervdsion of the trip coordinator. 

Recycle and esqpMd the progr^ to service Mre pupils 
maintaining existing pupil-staff ratios , ... V 

5» More funding for lower teacher-pupil ratios would be helpfiU.. 

6 , Each summer school ,naist be provided with sufficient educational 
materials. Where requested this should include prograDroed 
materials such as the IGND kits and the EDL kits. 

Since additional fimds were not available^ the pro^ajn did not have 



0> 



26 



22 



the flnsmcial resources to incorporate these suggestions into the program. 

However, with respect to Baterials, each school was aslied to provide 

adequate st5)plies and instructional materialB. AH sites had adequate 

materials , with sOTe having mioh more thBM others , 

7. Intersetting comunicatlons regarding educational teelmiquei 
wist he fostered through more plajmed meetings. This should 
be done hefore the start of the smmmT progrwa if possible. 

The response to this reccroTCndation in the pr^osal referred to the 

continuous widespread earpans ion during the regular school year of an 

individualised reading program of diagnosis and prescription, with 

acco^anying intra-school workshops. However when considering that nmy 

of the suBimer staff were not Involved with teaching readtog during the 

year, the need for a total orientation pro-am is reaffiimed. If this 

''einnot"b^cmu^ted--prior-to-the~hegi funding= = 



restrictions, the first day of the program should be a full day IntensiTe 
orientation, consisting o f demon strations wd works hops f or ^ s tgervls ors, 
teachers, wid paraprofessionals. This is the only way to insure maximal 
effectiveness of the reading progr^. 
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Chapter IV l SU1#IARY OF MAJOR FmDDKSj CONCLlBI^Sj MD raCOl^IDMIQNS 



The major e^raluation objeetiva of this pro^aa vas acliev^ iji that 
70 percent of the part leipa^ti mastered at least one Instruetional objective 
which prior t© the progr^ they did not mater. Thm data further indiaated 
that the COT system was an effeetive ijistruetional preaedure ae e-vldenced 
by the pDit^instruetion mastery of SO instruetiaiial objectives by 35 to 100 
percent of the students attesting them* 

ProgrM implementation was as propoaed with the exertion of having 
90 percent (lUSif) of the anticipated l6U0 participMts. .^e pi^ils esqjressed 
and observed attitudes and behaviors further attested to the effectiveness 
of the progTM. In consideration of the factors Mntioned above it is 
stron^y reconnaended that this program be recycleds 



The following recOOTiendationi for strengthening the program were 

based on the findings and site observBtlonsi 

~~^lT~BlWe^sh^TiXd^bC^pTov^^ 

If it camot be arranged prior to the program becat^e of funding 
probleiBs, one MU. day should be devoted to an orientation 
workshop for ^JL staff meters* The criterion-referenced test 
tadl* idualized approach to teaching reading should be thoroughly 
esqjlored. Test selection, pretesting^ retestingp scoring^ record 
keeping, should be amsng the aspects discussed. Instructional 
methods and materials should be reviewed^ C<Mplete printed^ descrip* 
tive materials with exa^les should be distributed to every staff 
member. 

2. All sites should have a teacher-ta-aharge to st^ervise the instruc- 
tional and recreational activities. Wiere this is unfeMible one 
teacher shoiJ^d be resins ible for coordinating the prap*am and be 
directly accountable to the teacher-ia-chaj'ge. 

3. The instructional itaff shotJid to the greatest extent possible 
have had prior experience in the teaching of readJja 

At each site, the suiamer program's tew her- in-charge should act 
as a liaison to articulate on behalf of the program with the 
regular supervisor Iji InGtances where this is a different person 
and staffs This shoi^d begiji in early Spring to assure advance 



publicity for the progrm^ facilitata Belaetion af pi^ili, 

and perait utilization of the echDoli* or eenters* instructiMal 

siatarialSj reading laboratories BnA. auHpli^^- 

5* The record keeping procedures for a oriterlon-refereaced test 
gyatM ihoiad be siJ^lifiedp All posttest data^ paae^ fail, 
ar absent should be inclmied far each pupils 

6, The progTi^ shatad be e^mded ta service a greater nuntoer of 
eligible pupils mijitaining the teacher-pt^il ratio. 
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